Human Computation for Hcir Evaluation

نویسنده

  • Shiry Ginosar
چکیده

A novel method for the evaluation of Interactive IR systems is presented. It is based on Human Computation, the engagement of people in helping computers solve hard problems. The Phetch image-describing game is proposed as a paradigmatic example for the novel method. Research challenges for the new approach are outlined.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Symposium on Human-Computer Information Retrieval.

Human-computer information retrieval (HCIR) is the study of information retrieval techniques that integrate human intelligence and algorithmic search to help people explore, understand, and use information. Since 2007, we have held an annual gathering of researchers and practitioners to advance the state of the art in this field. This meeting report summarizes the history of the HCIR symposium ...

متن کامل

IRIS-IPS: An Interactive People Search System for HCIR Challenge

In this report, we described the IRIS-IPS, an interactive people search system for HCIR 2012 data challenge. IRISIPS can recommend candidates from three different aspects, i.e. the content based relevance, the candidates’ authority rank and the social similarity. The social similarity is measured by the closeness between a candidate and the support entity list. The default the support entity li...

متن کامل

Designing for Collaboration in Information Seeking

Information seeking is often a collaborative activity that can take can take many forms; in this paper we focus on explicit, intentional collaboration of small and explore a range of design decisions that should be considered when building HumanComputer Information Retrieval (HCIR) tools that support collaboration. In particular, we are interested in exploring the interplay between algorithmic ...

متن کامل

Session-based search with Querium

We illustrate the use of Querium, a novel search system designed to support people’s collaborative and multisession search tasks, in the context of the HCIR 2011 Search Challenge. This report demonstrates how a Querium’s interface and search engine can be used to search for documents in an open-ended, exploratory task. We illustrate the use of relevance feedback, faceted search, query fusion, a...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011